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Abstract — In this paper we address the problem of trans- 
mission of correlated sources over a fast fading multiple access 
channel (MAC) with partial channel state information available 
at both the encoders and the decoder. We provide sufficient 
conditions for transmission with given distortions. Next these 
conditions are specialized to a Gaussian MAC (GMAC). We 
provide the optimal power allocation strategy and compare the 
strategy with various levels of channel state information. 
Keywords: Fading MAC, Power allocation, Partial channel state 
information, Correlated sources. 

I. Introduction and survey 

Sensor networks are used in a wide variety of applications 
due to their ability to operate in environments where human 
penetration is not possible. These networks are characterized 
by inexpensive sensing nodes with limited battery power 
and storage and hence limited computing and communication 
capabilities [2]. The sensor nodes may often be deployed for 
monitoring a random field. Due to the spatial proximity of the 
nodes, sensor observations are correlated. One often needs to 
transmit these observations to a fusion center through wireless 
Unks which experience multipath fading. The encoders and 
decoder often have only a partial information about the channel 
state as it has to be learnt. This happens because the estimate of 
the channel state will often not be accurate. But some estimate 
of the channel state may be available from 'Hello' messages 
passed. A fundamental building block for such a network is a 
fading Multiple Access Channel (MAC) with partial channel 
state information at the encoders and the decoder We study 
such a system in this paper 

In the following we survey the related literature. Cover, 
El Gamal and Salehi [5] provided sufficient conditions for 
transmitting losslessly discrete correlated observations over a 
discrete MAC. They also show that unlike for independent 
sources, the source-channel separation does not hold. These 
techniques were extended to more general models with dis- 
crete sources and channels and lossless transmission in [1]. 
Reference [19] extends the result in [5] and obtains sufficient 
conditions for lossy transmission of correlated sources over a 
MAC with side information. 
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The multi-access fading channels with independent inputs 
were considered in the excellent survey [3]. They show that 
unlike in the single user case, in the multi-access realm the 
optimal power control yields a substantial gain in capacity. 
The optimal power allocation strategy for the symmetric case 
is to allow the user with the best channel to transmit at a time 
(Random TDM A) ([11]). The instantaneous power allocated to 
a user is by the well known 'water-filling' algorithm in time. 

Multiple-access techniques for fading cellular uplink model 
with adjacent cell interference are discussed in [20]. 

Das and Narayan [7] obtained the capacity for a time 
varying MAC with varying degrees of channel state informa- 
tion at the encoders and the decoder as a union of regions 
characterised by limits of mutual information. A single letter 
specialization of this result to a fading memoryless channel 
with stationary ergodic state process, perfect CSIR and partial 
CSIT is given in [10]. The case with perfect CSIT and no 
CSIR is studied in [21]. 

The capacity of a fading Gaussian channel with channel 
state information (CSl) at the transmitter and receiver and 
at the receiver alone are provided in [9]. It was shown 
that optimal power adaptation when CSl is available both 
at the transmitter and the receiver is 'water filling' in time. 
The capacity region of the Gaussian MAC (GMAC) with 
independent inputs is available in [6]. The distributed Gaussian 
source coding problem is discussed in [15], [23]. Exact rate 
region for two users is provided in [23]. Joint source-channel 
coding schemes for transmission of correlated sources over 
a Gaussian MAC are also discussed in [8] and [12]. Hanly 
and Tse ([22]) have generalized the results on a GMAC with 
independent inputs to a flat fading GMAC with perfect CSl 
at both the transmitters and the receiver Gaussian MAC with 
independent sources, partial CSIT and perfect CSIR is studied 
in [14] for lossless transmission. 

An explicit characterization of the ergodic capacity region 
and a simple encoding-decoding scheme for a fading GMAC 
with common data is given in [13] for lossless transmission. 
Optimum power allocation schemes are also provided. 

Joint source channel coding for correlated data on a fading 
MAC with perfect CSl at the transmitters (CSIT) and perfect 
CSl at the receiver (CSIR) is studied in [18]. Various power 



allocation schemes are studied and it is shown that the Random 
TDMA scheme is suboptimal for transmission of correlated 
sources. Optimal power allocation strategies to minimize the 
sum distortion for transmission of discrete and Gaussian 
sources over a GMAC are given. 

This paper makes the following contributions. Sufficient 
conditions for lossless and lossy transmission of correlated 
sources over a fading MAC with partial state information 
available at the encoders and the decoder are obtained. The 
source alphabet and/or the channel alphabet can be discrete or 
continuous. The conditions are specialized for GMAC and an 
optimal power allocation policy is derived. The performace 
of the power allocation policy for various levels of channel 
state information is studied. The power allocation poUcies 
are used in combination with joint sources-channel codes 
to transmit correlated sources over fading channels. Various 
previous results are shown as special cases. 

The rest of the paper is organized as follows. Sufficient 
conditions for transmission of correlated sources over a fading 
MAC with partial CSIT and partial CSIR are provided in 
Section II. The special cases are provided in Section HI. These 
conditions are specialized to a fading GMAC in Section IV. 
Section V obtains the optimal power allocation pohcy. Section 
VI concludes the paper. Proof of the main result is given in 
the Appendix. 

II. Transmission of correlated sources over a 

FADING MAC WITH PARTIAL CSIT AND PARTIAL CSIR 

In this section we consider the transmission of memoryless 
dependent sources, through a memoryless fading multiple 
access channel. The sources and/or the channel input/output 
alphabets can be discrete or continuous. The transmitters and 
the receiver have partial knowledge of the fade state of the 
channel at that time. 

We consider two sources {Ui,U2) with a known 
joint distribution F{ui,U2)- The random vector sequence 
{{Uin,U2n), n > 1} formed from the source outputs with 
distribution F is independent identically distributed (iid) in 
time. The sources transmit their code words Xj's to a sin- 
gle decoder through a memoryless, flat, fast fading mul- 
tiple access channel. Let (iJi„,iJ2r») be the fade state at 
time n, n > 1. We assume {{Hin,H2n), n > 1} to 
be an iid sequence, although (Hin,-ff2n) can be depen- 
dent and can be discrete or continuous valued. Similarly 
{Hin, H2n), {Hin, ^^2n) denote the channel state information 
available at the transmitters and the receiver respectively. 
{Hin, H2n, Hin, H2n, Hin, -^2n) are Hd in time. The channel 
output Y has distribution p{y\xi,X2,hi,h2) if xi and X2 are 
transmitted at that time and the channel is in the fade state 
(/ii,/i2). The decoder receives Y and estimates the sensor 
observations Ui as Ui, i = 1,2. 

It is of interest to find encoders and a decoder such that 
{Uin,U2n,n' > 1} can be transmitted over the given fading 
MAC with E[di{Ui,lJi)] < Di, i = 1,2 where di are non- 
negative distortion measures and Di are the given distortion 
constraints. Encoder i knows Uin and {Hin,H2n) at time n. 



This situation corresponds to the scenario where the channel 
state is broadcasted to the encoder via a third party by means 
of wayside channels (see [4]). We will assume that di are such 
that di{u,u') = if and only if u = u'. If the distortion 
measures are unbounded we also assume that there exist 
u*, i = 1,2 such that E[di{Ut,u*)] < oo, i = 1,2. This 
condition is satisfied in the important special case of mean 
square error if we take u* to be E[Ui] and E[Uf] < oo. 

Due to correlated sources, source channel separation does 
not hold in this case. 

We will denote Uij,j = l,2,...,nby U",i = 1,2. Also x 
will denote a realization of a random variable X. 

Definition : The sources (J7f , f/J') can be transmitted 
over the fading multiple access channel with distortions 
D=(Di, D2) if for any e > there is an Uq such that for all 
n > no there exist encoders ^ : Ur" xH'l xH^ ^ Xp, i = 
1, 2 and a decoder : x HI x H'l ^ (^1",^?) such that 



is 



YTi=id{Uij,u^j) 



< D, 



+e, i = 



1,2 where {U^,U1^) = 

fD{Y'',H^,H^) andUi, Hi, Hi, Hi, Xi, y, Ui are the sets 
in which Ui, Hi, Hi, Hi, Xi, Y and Ui take values. 

Since the MAC is memoryless, , /i", /i2 ) — 

YYj=iP{Vj\xij,X2j,hij, h2j). In the following X <-> F Z 
wiU indicate that {X, Y, Z) forms a Markov chain. 

Now we state the main Theorem. 

Theorem 1: A source can be transmitted over a fading 
multiple access channel with distortions {Di,D2) if there exist 
random variables {Wi,W2,Xi,X2) such that 

1. p{hi,h2,hi,h2,hi,h2,ui,U2,wi,W2,xi,X2,y) = 
p{h\,h2,hi,h2, hi,h2)p{ui,U2)p{wi\ui)p{w2\u2) 

p{xi\wi,hi,h2)p{x2\w2, hi,h2)p{y\xi,X2, hi,h2). 

2. There exists a function /p : Wi x W2 x Wi x 7i(:2 ^ 
{Ui X U2) such that E[d{Ui,Ui)] < Di, i = 1,2 and the 
constraints 

IiUi;Wi\W2) < I{Xi-Y\X2,W2,Hi,H2), 
I{U2;W2\Wi) < I{X2;Y\Xi,Wi,Hi,H2), (1) 
I{Ui,U2;Wi,W2) < I{Xi,X2;Y\Hi,H2), 

are satisfied where Wi is the set in which Wj take val- 
ues. ■ 

If the channel input alphabets are continuous valued then 
the XiS should also satisfy given power constraints ] < 
Pi, i = l,2. 

The proof of the theorem is given in the Appendix. The 
proof extends directly to the multi-user case (with the number 
of users > 2). Let S = 1,2,.. .,M be the set of sources 
with joint distribution p{ui,U2, ■■■,iim). Hs denotes the set 
{Hi,H2, ■■■,Hm}- Similarly we define Hs and Hs for the 
CSIT and CSIR respectively. 

Theorem 2: Sources (?/,", i G S) can be communicated in a 
distributed fashion over the memoryless fading multiple access 



I{Ui;Wi\W2) < 0.5B 
I(U2\W2\Wi) < 0.5B 

I(Ui,U2;Wi,W2) < 0.5E 



log 1 + 



log 1 + 



|-H"i|^Pi(-H"i,g2)(l -p^) 

|-H"2pP2(-H"l,g2)(l - P^) 



(2) 



log 1 + 



|_f/i|^_Pi(iJ-i,if2) + \H2\^P2iHi,H2) + 2\Hi\\H2\p^PiiHi,H2)P2iHuH2) 



channel p{y\xi,i e S) with distortions {Di,i e 5) if there 
exist auxiliary random variables {Wi,Xi,i £ S) satisfying 

1. p{u,,Wi,Xi,y,hi,hi,h,,i G S) ^ p{hi,h,,h,,i £ S) 

p{ui,i e S)p{y\xi,hi,i G S) Y\_Piwj\uj)pixj\wj,hs). 

jes 

2. There exists a function : Iljgs x ^ {Ui,i E S) 
such that E[d{Ui, Ui)] < Di, i E S and the constraints 

are satisfied for all A C 5 (in case of continuous channel 
alphabets we also need the power constraints < 
P„ i = 1,..,A/). ■ 
In Theorem [T| it is possible to include other distortion 
constraints. For example, in addition to the bounds on 
E[d{Ui,Ui)] one may want a bound on the joint distortion 
E[d{{Ui, U2), {Ui, ^^2))]. Then the only modification needed 
in the statement of the above theorem is to include this also 
as a condition in defining //j. 

III. Special Cases 

In the following we show that our results contain several 
previous studies as special cases. 

A. Lossy transmission of correlated sources with perfect CSIT, 
perfect CSIR 

Take (i?i,^2) = (^^1,-^2) = (i^l,i^2), then we recover 
the conditions given in [18]. 

B. Lossless transmission of independent sources with partial 
CSIT, perfect CSIR 

Take {Ui, U2) as discrete valued and {Hi, H2) = {Hi, H2)- 
Also, H = {Hi,H2), U1I.U2 (i.e., Ui is independent of U2). 
We also take (W^i, M^2) = {Ui, U2)- Then we need to code at 
rate i?i and R2 satisfying 

H{Ui)<Ri < I{Xi;Y\X2,U), 
H{U2)<R2 < I{X2;Y\Xi,Ti), 
H{UiU2) < R1+R2 < I{Xi,X2;Y\Ii). 

In the above equations Xi and X2 are generated using 
{Hi, H2) and are independent of {Ui, C/2). 

These are the conditions given in [10] and specializations 
of the general conditions in [7]. 



C. Lossless transmission of independent sources with Perfect 
CSIT, no CSIR 

Take {Hi,H2,Hi,H2) = {Hi,H2,l,l) and {Wi,W2) = 
{Ui,U2)- We consider no channel state information at the 
decoder and perfect channel state information at the encoders. 
Then one needs to code at rates i?i and R2 satisfying 

H{Ui)<Ri < I{Xi;Y\X2), 
H{U2)<R2 < I{X2;Y\Xi), 
H{UiU2) <Ri+R2 < I{Xi,X2;Y). 

These are the conditions in [21]. 
IV. Fading Gaussian MAC with partial CSIT, 

PERFECT CSIR 

In a fading Gaussian MAC the channel output Yn at time n 
is given by y„ = i?i„Xi„ + i^2«-^2n + where Xi„ and 
X2n are the channel inputs at time n and {Nn} is iid with 
a Gaussian distribution and is independent of Xin and X2n- 
Also, E[Nn] — and var{Nn) — cr^. and H2n are the 
fade states of the channel at time n. The power constraints on 
the channel inputs are E[Xf] < Pi, i = 1,2. The distortion 
measure will be Mean Square Error (MSB). Let p be the 
correlation between the channel inputs Xi,X2- 

For this GMAC, following the experience in [17] we relax 
the first two inequalities in ([T]) to make them more explicit. 
These are then used to obtain efficient signaling schemes 
to satisfy ([T]). For this the right hand side (RHS) of the 
first two inequalities in ^ are replaced by upper bounds 
I{Xi;Y\X2,Hi,H2) and I{X2;Y\Xi,Hi,H2) respectively. 
It is shown in [17] that these upper bounds are quite tight 
whenever these two inequalities are active (generally it is the 
third inequality which is tight). Also, it is shown in [17] that 
for a given {hi, h2), these upper bounds and the RHS of the 
third inequality in ([T]) are maximized by choosing {Xi, X2) to 
be zero mean, jointly Gaussian r.v.s with — Pi{hi, ^12) 

where Pi{hi,h2) are appropriately chosen. If such {Xi,X2) 
have correlation p these three bounds provide (|2]l. 

The expectation is over the joint fade state {hi, h2, hi, h2)- 
We also need to choose the power control policies Pi{hi, h2) 
such that the average power constraints 

E[P,{Hi,H2)]<P,, i = l,2, (3) 

are satisfied. This motivates us to consider Gaussian coding 
schemes. 



An advantage of ^ is that we will be able to obtain explicit 
source-channel coding schemes to satisfy (|2|i. These may be 
difficult to identify from ^ itself. Once we have obtained 
these coding schemes we can verify the sufficient conditions 
([T]i themselves. If satisfied these will ensure that the coding 
schemes can ensure transmission with given distortions. If not, 
one can change p to finally satisfy Thus in the rest of the 
paper we consider some power allocation policies along with 
Gaussian signaling schemes which can be used to satisfy the 
conditions O. 

A. Special Case 

Specializing the theorem for independent sources and loss- 
less transmission recovers the result in [14]. 

V. Optimal power allocation for the GMAC 

We consider a power allocation policy such that the RHS 
in the third inequality of (|2]i is maximized and the other 
conditions are satisfied. This is done because often the third 
inequality is the constraining condition. In [18] this policy 
was compared with sevaral other power allocation policies and 
was found to perform better. This optimal power allocation 
policy is obtained numerically. It depends upon p which in 
turn depends on the source correlation p. 

To find a p such that all the three inequalities are satisfied 
by the optimal policy, we can use the following procedure. 
We consider an iterative algorithm in which the channel input 
correlation p is chosen in such a way that the third inequality 
is satisfied. Then we check for the other two inequalities. 
If they fail then the p is decreased so that all the three 
conditions are satisfied, if possible. These computation need 
to be done only once for a given source pair distribution. Also, 
the computational requirements are modest. 

One of the performance measures is to maximize the RHS in 
the third inequality of The optimal power allocation policy 
discussed in the beginning of this section maximizes this. We 
take Pi = P2 = 1. The channel correlation {p) achievable 
depends on the source correlations and the scheme used. The 
fade states hi, h2 take values in (1, 0.5) with equal probability 
and are independent of each other. The channel noise is zero 
mean with unit variance. The channel state information at the 
transmitter (CSIT) is a noise corrupted version of the fade 
state. Thus the CSIT can be modeled as the output of a binary 
symmetric channel (BSC) with fade states as the input and 
with a suitable cross over probabilty p. The results provided 
are exact computations of RHS of (|2]l. 

We compare the performance of the optimum power al- 
location that maximizes the RHS in the third inequality of 
(|2]i for various values of CSIT. Figure [T] compares the cases 
with perfect CSIT (p = 0), partial CSIT (p = 0.1,0.25) and 
no CSIT (p = 0.5). For the no CSIT case uniform power 
allocation (UPA) is the optimal power allocation policy as the 
objective function is monotonic in both Pi and P2. 

We observe that uniform power allocation (UPA) performs 
well at high p and is comparable to the optimum power 
allocation when p is close to 0.5. 
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Fig. 1. Maximum sum rate with partial CSIT, Pi = P2 = 1 

Figure |2] shows the variation in the maximum sum rate for 
various p. 
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Fig. 2. Maximum sum rate, Pi = P2 = 1, P = 0.5 

A. Discrete sources 

Next we obtain the optimum power allocation for transmit- 
ting correlated discrete sources over a GMAC with various 
levels of partial CSIT. Consider the lossless transmission of 
discrete sources {Ui, U2) over a fading GMAC. Such a system 
is most commonly encountered in practice. We consider the 
example where the sources {1/1,1/2) have joint distribution 
given by P{Ui = 0; C/2 = 0) = P{Ui = l;C/2 = 1) = 
P{Ui = 0; C/2 = 1) = 1/3; P{Ui = 1; C/2 = 0) = 0. The fade 
states hi, /12 take values in (1, 0.5) with equal probability and 
are independent of each other The power constraints on the 
channel inputs {Xi, X2) are (5, 5). The channel noise is zero 
mean with unit variance. 

For lossless transmission the left hand side (LHS) in (|2]l 
become H{Ui\U2), H{U2\Ui) and H{Ui,U2) respectively 
and they evaluate to 0.667, 0.667 and 1.585. Let the sources 



be mapped to channel codewords with correlation p ~ 0.3. 
Such correlation preserving mappings are discussed in [17]. 
If we using UPA the RHS in the third inequality evaluates to 
1 .5030 and the sources cannot be transmitted over the channel 
losslessly. Using the optimum power allocation scheme for 
perfect CSIT and CSIR, RHS evaluates to 1.6071. The RHS 
in the first two inequalities evaluate to 0.8755 with the 
optimal policy. This ensures that the sources can be transmitted 
losslessly. 

Now we consider partial CSIT and perfect CSIR for the 
above example. The partial CSIT is modeled as the output of 
a BSC with suitable crossover probability p as shown above. 
For p ~ Q.l the RHS in the third inequality is 1.585 and the 
first two inequalities are 0.8650. Hence with this partial CSIT, 
we are able to transmit the given sources over the GMAC 
losslessly. 

B. Gaussian Sources 

Consider the transmission of correlated Gaussian sources 
over a GMAC. The sources are assumed to have zero mean, 
unit variance and correlation p. The power constraints on the 
channel inputs are (Pi, P2) and channel noise variance is unity. 
The performance measure is to find the minimum distortion at 
the decoder for given sources, power constraints and channel 
noise variance. The distortion criterion is mean square error 
(MSB). 

In [16] and [18] we have discussed three joint source chan- 
nel coding schemes for transmission of Gaussian sources over 
a GMAC. It is found that the Lapidoth-Tinguely (LT) scheme 
(developed in [12]) is a good coding scheme that performs well 
over all SNR regions. In this scheme the sources are vector 
quantized and mapped to correlated Gaussian codewords. The 
decoding is by jointly typical decoding followed by estimation 
of the sources. 

We use the optimum power allocation scheme obtained 
above with LT scheme to obtain the distortions for different 
levels of CSIT We assume perfect CSIR in all cases. We will 
take (Pi,P2) = (5, 5) and aj^ — 1. The fading processes are 
as in Section IV-AI 

The minimum distortions achieved for p = 0,0.1,0.25 
and 0.5 are plotted in Figure |3] The distortions for the 
Gaussian sources are also computed from (|2j by choosing 
Wi as vector quantized version of Ui with rate Ri and 
finding t;ar[t/i|VFi, VF2], « = 1, 2. p = corresponds to 
the perfect CSIT case and p = 0.5 corresponds to UPA. For 
comparison purposes the minimum distortions achieved in a 
channel without fading are also provided. It is seen from this 
figure that the partial CSIT affects the distortions more at 
lower p. The fade state (1, 0.5) is not that strong a channel 
value. If the channel state can get worse, our optimal algorithm 
will perform better compared to UPA as the power allocation 
guarantees allocation of power to good states only. 

VI. Conclusions and Discussion 

In this paper, sufficient conditions for transmission of cor- 
related sources over a fading MAC with partial CSIT and 
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Fig. 3. Minimum distortion for LT, Pi = P2 = 5 

CSIR are provided. These conditions are specialized to a 
GMAC and used to obtain a good power allocation policy. This 
policy is then used with efficient joint source-channel coding 
schemes for transmission of discrete and Gaussian sources. 
Consequently, we have identified very efficient (even though 
not provably optimum) signalling schemes for a fading GMAC 
with partial CSIT and CSIR. 

The results in this paper are information-theoretic and hence 
address the fundamental limitations of the communication 
system. In this paper, the codes used are of infinite length 
and the encoders and decoder used provide the best conditions 
that are feasible. In practice, one needs to develop practical 
coding schemes to design a system that can perform close 
to the optimal conditions provided here. Also, our results, as 
often happens in information theory, can provide significant 
insights in designing practical codes and the power control 
algorithms. 

Appendix 

First we consider discrete sources and channel inputs. 
Comments to include the continuous sources/channel inputs 
are provided at the end of the proof. 

The scheme involves distributed quantization (W^",!^!*) 
of the sources followed by a correlation preserving mapping 
to the channel codewords depending on the channel state. 
The decoding approach involves first decoding the quantized 
version (W^f, M^z") of (C/f, U^) using (F", H^, H^) and then 
obtaining estimate (t/i, IJ2) as a function of (VF", W2 )- 

We show the achievability of all points in the rate region 

Proof -.^ Fix p{'Wi\ui), p{w2\u2), p{xi\'Wi,hi,h2), 
p{x2\w2, hi, h2) as well as satisfying the distortion 
constraints. 

Codebook generation: Let = I{Ui;Wi) + 6, i — 1,2 
for some S > 0. Generate 2"^' codewords of length n, 
sampled iid from the marginal distribution p{'Wi), i = 1,2. For 
each and (ft,",ft,2) independently generate sequence X" 



according to HjLi ^ij ' '^sj), i = 1,2. Call these 

sequences x"(it;", /i", /ij ), i G 1,2. Reveal the codebooks to 
the encoders and the decoder 

Encoding: For i £ {1,2}, given the source sequence 
and hi, , the i*'* encoder looks for a codeword M^" such that 
(C/f , Vt^") e T,"(J7,, VFi) and then transmits X'^{W^, h'l, h"^) 
where r"(.) is the set of weakly e-typical sequences ([6]) of 
length n. 

Decoding: Upon receiving y", for a given {hi^K^) 
the decoder finds the unique (W^jlVn) pair such that 

where , /12 takes values in /i",/!^. If it fails to find such 



a unique pair, the decoder declares (u* 



In the following we show that the probability 
of error for the above encoding, decoding scheme 
tends to zero as rt cx). By Markov Lemma 

([6]), p{(c/r, c/2", wriu^), w^{u^), xnwr, kMi 

X^{W^,kl, y") e Tf } ^ l as n -> oo. The eiTor can 
occur because of the following three events E1-E3. We show 
that P{EiTl) 0, for i = 1, 2, 3. For simplicity we take 5 = e. 

El The encoders do not find the codewords. However from 
rate distortion theory [6], P. 356, 
lim„^oo P[Ei) = if i?; > /(C/,; VKO, i e 1, 2. 

E2 There exists another codeword such that 

Define a=(u;?, M^s", x^{w^, h'l h'^),x'^{W?, /i" , h'^), F")- 
Then, 

P(E2) = P{There is w"^ ^ w'l : a e T^} (4) 

Denote {(a;^ (.), y") : a G T,"} by A The probability 

term inside the summation in (|5]l is 

< J2 p{^U^'iXX2),x^{w^XX), 2/"K, ^i^^N h^} 

A 

<Y,p{x^i{w^XX2)\w'i,KX} 

A 

p{x^{w^XX),y"\w^XX} 

< ^ 2~"{^(^il^i>^i^-f^2) + H(X2,i'|W2:Hl,-H2)-4e} 
A 

^ 2"-H"(-^i.^2,"i'|Wi,W2.iJ"i,H2) 

2-n{H(Xi|H'i,Hi,ff2) + H(X2,i'|W2,-Hi,-H2)-6£} 

But from hypothesis, we have 

HiXi,X2,Y\Wi,W2,Hi,H2)-HiXi\Wi,Hi,H2) 
-H{X2,Y\W2,HuH2) = -I{Xi:Y\X2,W2,Hi,H2)- 

Hence, 



pm,w^,x-i{w^,hih;),x^iw^,hi,h;),Y-) e rn 

^ 2-n{I{Xi;Y\X2,W2,Hi,H2)-6<L} 



Then from ^ 

P(E2) < ^ 2""t-f(-^i'^l^2,H'2,ffl,if2)-6e} 

to " lu " : ( l5) " , -ii) J ) g Tj» 

< |{< : (wi,w2) e r,"}|2-"^^(-^i''^i^^'^^-^i'-f^^)-^'> 

2"{-f('^i;W'i)+c}2-"{-f(Wi;W2)-e} 

2-n{/(Xi;y-|X2,W2,ifi,H2)-6e} 

^ 2"{-f('^i;^i|i^2)}2~"{-f(-^i;'^l'^2,w'2,Hi,iJ"2)-8€} 

(6) 

The R.H.S of the above inequality tends to zero if 

I{Ui\Wi\W2) < I{XuY\X2,W2,Hi,H2). In I© we have 
used the fact that 

I{Ui-Wi) - I{Wi-W2) ^ I{Ui-Wi\W2). 
Similarly, by symmetry of the problem we require 

I{U2;W2\Wi) < I{X2;Y\Xi.,Wi,Hi.H2). (7) 

E3 There exist other codewords and W2 such that 

a^[w^,w^,xUw^XX2),x^{w^XX2)X) G T^- 

Following the steps similar to that for P(E2), P(E3) 
approaches zero for large n if /(C/i, C/2; M^i, VF2) < 
I{Xi,X2;Y\Hi,H2). 

Thus as rt ^ 00, with probability tending to 1, the decoder 
finds the correct sequence (W", W2) which is jointly weakly 
e-typical with {V^^U^). 

The fact that {W^ , VF2") is weakly e-typical with (C/f, U^) 
does not guarantee that will satisfy the dis- 

tortions Di,D2- For this, one needs that (1^",!^^') are 
distortion-e-weakly typical ([6]) with {U", J/;^). Let ^ de- 
note the set of -e-distortion typical sequences. Then by strong 
law of large numbers P{T^ e|27') ^ 1 as n ^ 00. Thus the 
distortion constraints are also satisfied by (W", W2) obtained 
above with a probability tending to 1 as n — > 00. Therefore, 
if distortion measure di is bounded lim„^oo E[d{U[^, U^)] — 
A + e, i = 1,2. 

If there exist u* such that E[di{Ui,u*)] < 00, i = 1,2, 
then the result extends to unbounded distortion measures also 
as follows. Whenever the decoded {WJ^, W2) are not in the 
distortion typical set then we estimate ([/", U2 ) as (u*", ^2")- 
Then for i ~ 1,2, 



E[d,{Ul\Un]<D, 



p[d(c/r,<")i{(Tsj=}]. (8) 



00, 



Since E[d(U^ ,u*"')] < 00 and P[{TJi, J''] as n 
the last term in RHS of ([8]) goes to zero as n 00. 

The above proof also hold for continuous alphabet sources 
and channels. The Markov lemma and weak typical decoding, 
the devices used to prove the theorem continue to hold and 



the proof extends with E[Xl] < Pi i = 1,2. 



References 



[1] R. Ahlswede and T. Han. On source coding with side infomiation via 

a multiple access channel and related problems in information theory. 

IEEE Trans. Inform. Theory, IT-29(3):396-411, May 1983. 
[2] 1. F. Akylidiz, W. Su, Y. Sankarasubramaniam, and E. Cayirici. A 

survey on sensor networks. IEEE Communications Magazine, pages 

1-13, August 2002. 
[3] E. Biglieri, J. Proakis, and S. Shamai. Fading channels: Information 

theoretic and communication aspects. IEEE Trans. Inform. Theory, 

44(6):2619^2692, Oct. 1998. 
[4] Y. Cemal and Y. Steinberg. The multiple access channel with partial 

state iirformation at the encoders. IEEE Trans. Inform. Theory, 51(11), 

Nov. 2005. 

[5] T. M. Cover, A. E. Gamal, and M. Salehi. Multiple access channels 

with arbitrarily correlated sources. IEEE Trans. Inform. Theory, IT - 

26(6):648-657, Nov 1980. 
[6] T. M. Cover and J. A. Thomas. Elements of Information theory. Wiley 

Series in Telecommunication, N.Y., 2004. 
[7] A. Das and R Narayanan. Capacitis of time varying multiple access 

channels with side information. IEEE Trans. Inform. Theory, 48(1):4- 

25, Jan. 2002. 

[8] M. Gastpar and M. Vetterli. Power spatio-temporal bandwidth and 
distortion in large sensor networks. IEEE JSAC, 23(4):745-754, April 
2005. 

[9] A. J. Goldsmith and P. P. Varaiya. Capacity of fading channels with 
channel side information. IEEE Trans. Inform. Theory, 43(6): 1986- 
1992, Nov 1997. 

[10] G. Keshet, Y. Steinberg, and N. Merhav. Channel coding in the presence 
of side information: Subject review. NOW, June 2008. 

[11] R. Knopp and P. A. Humblet. Information capacity and power control 
in single-cell multiuser communication. Proc. Int. Conf. on Communi- 
cation, ICC'95, Seattle.WA, pages 331-335, June 1995. 

[12] A. Lapidoth and S. Tinguely. Sending a bi- variate Gaussian source over 
a Gaussian MAC. IEEE ISIT 06, 2006. 

[13] N. Liu and S. Ulukus. Capacity region and optimum power control 
stategies for fading Gaussian multiple access channels with common 
data. IEEE Trans, communication, 54(10): 1815-1826, Oct. 2006. 

[14] M. Mecking. Achievable rate for fading multiple access channels with 
partial channel state information. IEEE ISIT, 2002. 

[15] Y. Oohama. Gaussian multiterminal source coding. IEEE Trans. Inform. 
Theory, IT -43(6): 1912-1923, Nov 1997. 

[16] R. Rajesh and V. Sharma. Source channel coding for Gaussian sources 
over a Gaussian multiple access channel. Proc. 45 Allerton conference 
on Computing Control and Communication, 2007. 

[17] R. Rajesh and V. Sharma. A joint source-channel coding scheme for 
transmission of correlated discrete sources over a Gaussian multiple 
access channel. Proc. ISITA, Auckland, New Zeland, 2008. 

[18] R. Rajesh and V. Sharma. Transmission of correlated sources over a 
fading multiple access channel. In proc. 46 Allerton Conference on 
Computing Control and Communication, Monticello, IL, 2008. 

[19] R. Rajesh, V. K. Varsheneya, and V. Sharma. Distributed joint source- 
channel coding on a multiple access channel with side information. In 
Proc. IEEE ISIT 2008, Toronto, Canada. 

[20] S. Shamai and A. D. Wyner. Information-theoretic considerations for 
symmetric cellular, multiple-access fading channels part I. IEEE Trans. 
Inform. Theory, 43(6):1877-1893, Nov 1997. 

[21] S. Siguijonsson and Y. H. Kim. On multiple access channels with state 
information at the transmitters. IEEE ISIT, 2005. 

[22] D. Tse and S. V. Hanly. Multiaccess fading channels-part I: polymatroid 
structure, optimal resource allocation and throughput capacities. IEEE 
Trans. Inform. Theory, 44(7):2796-2815, Nov 1998. 

[23] A. B. Wagner, S. Tavildar, and P. Viswanath. The rate region of the 
quadratic Gaussian two terminal source coding problem. IEEE Trans. 
Inform. Theory, 54(5): 1938-1961, May 2008. 



